Metal-to-Insulator Transition, Spin Gap Generation, and Charge Ordering in 
Geometrically Frustrated Electron Systems 



m 

O 

o 

(N 
D 

l> 
(N 



Satoshi Fujimoto 

Department of Physics, Kyoto University, Kyoto 606-8502, Japan 
(February 6, 2008) 

We investigate a (semi-)metal to insulator transition (MIT) realized in geometrically frustrated 
electron systems on the basis of the Hubbard model on a three-dimensional pyrochlore lattice and 
a two-dimensional checkerboard lattice. Using the renormalization group method and mean field 
analysis, we show that in the half-filling case, MIT occurs as a result of the interplay between 
geometrical frustration and electron correlation. In the insulating phase, which has a spin gap, the 
spin rotational symmetry is not broken, while charge ordering exists. The charge ordered state is 
stabilized so as to relax the geometrical frustration in the spin degrees of freedom. We also discuss 
the distortion of the lattice structure caused by the charge ordering. The results are successfully 
applied to the description of the MIT observed in the pyrochlore system TI2RU2O7. 
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I. INTRODUCTION 



Geometrical frustration in both localized and itiner- 
ant electron systems is an important ingredient giving 
rise to a rich variety of condensed phases. In local- 
ized spin systems, magnetic frustration suppresses a ten- 
dency toward a conventional long-range order, and may 
stabilize some exotic state such as a spin liquid or a va- 
lence bond crystal, as has been extensively explored both 
experimentally^"^ and theoretically. Also, for itiner- 
ant systems, it has been argued that geometrical frus- 
tration may cause some novel phenomena such as heavy 
fermion state, anomalous Hall effect induced by the 
chiral order, and so forth. Among them, metal- 
to-insulator transition (MIT) in geometrically frustrated 
systems is an intriguing unsettled issue. It has been found 
experimentally that the pyrochlore oxides, TI2RU2O7 
and Cd20s207, and the spinel compounds, CuIr2S4 and 
MgTi204, exhibit MIT without magnetic long-range or- 
der at finite critical temper atures.'^^"^^ Since such sys- 
tems possess the fully-frustrated lattice structure, re- 
ferred to as a network of corner-sharing tetrahedra (that 
is, a pyrochlore lattice), the magnetic properties of the 
insulating phase are not yet understood. Moreover the 
mechanism of the MITs observed in these systems is still 
an open problem. In contrast to the localized spin sys- 
tems, the presence of charge degrees of freedom pro- 
vides a route for the relaxation of magnetic frustra- 
tion. However, when electron correlation is sufRciently 
strong, the magnetic frustration may still affect the low- 
energy properties significantly. Thus, it is expected that 
geometrical frustration plays an important role in the 
MITs. From this point of view, in the present pa- 
per, we study the interplay between electron correla- 
tion and geometrical frustration in the Hubbard model 
on a three-dimensional (3D) pyrochlore lattice and on a 
two-dimensional (2D) checkerboard lattice, the so-called 
2D pyrochlore (FIG.l). Although real pyrochlore ox- 



ides and spinel compounds have electronic structure com- 
posed of t2g orbitals, the present study on these simpler 
single-band models may provide important insight into 
the role of geometrical frustration in MIT. Furthermore, 
TI2RU2O7 has, apart from the t2g band, a nearly half- 
filled Tl s band, whose important features are described 
by the 3D pyrochlore Hubbard model. We believe that 
this model may provide a useful understanding of the 
MIT undergone in this material. 
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FIG. 1. 2D and 3D pyrochlore lattices. 

The non-interacting energy bands of these two Hub- 
bard models have a common interesting feature: They 
consist of a flat band (or two degenerate flat bands) on 
the upper band edge and a dispersive band that is tan- 
gent to the flat band (or flat bands) at the F point.'*" 
Itinerant ferromagnetism in the case that the flat bands 
are partially occupied has been extensively studied by 
several authors so far.^"''** This particular band struc- 
ture is due to the geometrical property of line graph in 
which the above 2D and 3D pyrochlore lattices are clas- 
sified. According to a theorem of the graph theory,^^ a 
tight-binding model on a line graph generated from a bi- 
partite graph with V vertices and E edges has flat bands 
with the degeneracy Df = \imN^oo{E — V + 1)/N lying 
on the band edge of dispersive bands. Here N is the total 
number of unit cells on the lattice. It should be noted 
that the existence of the flat bands is analogous to the 
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macroscopically large degeneracy of the ground state of 
classical spin systems on line graphs.^ Since line graphs 
consist of a network of complete graphs which have a 
frustrated structure, the presence of the flat bands is a 
result of geometrical frustration inherent in the lattice 
structure. We would like to stress that, to study effects of 
geometrical frustration in correlated electron systems, we 
should distinguish two classes of geometrically frustrated 
systems: one is the class of line graph, and the other 
is not, and does not possess flat bands. For example, a 
triangular lattice is classified in the latter class. In this 
paper, wc are concerned with the former class, and show 
that, in the half-filling case, the geometrical frustration 
in the above models drives the system into an insulating 
state with a spin gap as well as a charge gap. Also, in 
the insulating state, the spin rotational symmetry is not 
broken, while charge ordering exists. The results of this 
paper have been partially reported in Ref.43 before. 

The paper is organized as follows. In Sec. II, we in- 
troduce the model and present briefly some basic results 
derived by perturbative expansion in terms of electron- 
electron interaction. In Sec. Ill, the renormalization 
group method applied to the pyrochlorc Hubbard mod- 
els is developed. The results for the 2D and 3D cases are 
given in Sec. IV and V, respectively. In particular, we dis- 
cuss the (semi-)metal-to-insulator transition caused by 
geometrical frustration, and the properties of the insulat- 
ing state in which both spin and charge excitations have 
a gap. We confirm our results with the use of the mean 
field analysis. The effect of the coupling with lattice de- 
grees of freedom in the presence of the charge ordering is 
also discussed. Summary is given in Sec. VI. 



II. MODEL HAMILTONIANS AND SOME 
PERTURBATIVE RESULTS 



Our system is described by the single-band Hubbard 
model defined on the 2D checkerboard lattice or the 3D 
pyrochlore lattice shown in FIG.l. Diagonalizing the ki- 
netic term, we write the Hamiltonian as 



Ai=l kcr 



Eki = 2, 

Ek2 = 4 cos kx cos ky — 2, 



N 

k,k' ,g a/37(5 
^ ^k-qa-(^k'+ql3l"'k''rl"-kSt , 



(1) 



where m = 2 in the 2D case, and m = 4 in the 3D case. 
o-kua i^kfia) annihilation (creation) operator for 

electron with momentum k and spin a in the /x-band. 
In the 2D case, 



Sll(fe) = S22(fe) = 

S2l{k) = -Si2(fc) = 

In the 3D case, 
Eki = Ek2 = 2, 



Sin[(fca; + fey)/2] 
1/1 - cos k X COS ky 

_ sin[(A-,, - l-,j)/2] 
-^1 — cos kx cos ky 



Ek3 = -2 + 2VT+tk, 



(2) 
(3) 

(4) 

(5) 



(6) 
(7) 
(8) 



Ek4 = -2 - 2VT+h, 
tk = cos{2kx) cos{2ky) + cos{2ky) cos{2kz) 

-hcos(2A:^)cos(2fc2:). (9) 

Using the abbreviation, s{x ± y) = sin(A:a, ± ky) etc., we 
write down s^i, s^2(k) in the 3D case, 

(Sii(fc), S2l(fc), S3l(fc), S4l(fc)) 

= {s{x + z), s{y - z),-s{x + y), 0)/n+, (10) 



where n± = \J s{x ± z)^ -I- s{y =F z)"^ + s{x + y)^, and, 

(Sl2(fc), S22(fc), S32(fc), S42(A;)) 

= {s{x + z)s{x — z)s(y — z) 

-s{y + z){s{y - zf + s{x + yf), 

s{x -\- z)s{y + z)s{y - z) 

-s{x - z){s{x + z)"^ + s{x + yY), 

-s{x 4" y){s{x + z)s{y -\- z) + s{x - z)s{y - z)), 

s{x + y)nl)/n2, (11) 

for kx + ky ^ 0, where 712 = n+[n^n?_ — (s(x -|- z)s{y + 

z) + s{x — z)s{y — z)Y]^ , and, 

(Si2(fc), S22(fc), S32(fc), S42(fc)) 

= (-s(2a;), -s(2x), 2s{x - z), 2s{x + z)) 



X l/^2s{2xY + 4s(x - zf + 4s(x + zf (12) 

for kx + ky = 0. The expressions of s^3(fc) and Sju4(fc) 
are very complicated. However in the following, we need 
only Si_is{k) for small k, which is given by, 

(Sl3(fc), S23(fc), S33{k), S43{k)) 

— ( kx ky -\- k^^ kx ky -\- k^^ 
kx ~t~ ky kzt kx ky A;^)/2|A:|. (13) 

The annihilation operator of electrons at the fi-th site in 
a unit ceU is given by Ckua- = Y,T=i Sij,i^{k)akua- 

As mentioned in the introduction, these systems have 
the flat band(s), Eki for the 2D case, and Eki, Ek2 for 
the 3D case. In the half- filling case, n = 1, on which we 
concentrate henceforth, the flat band(s) is empty, while 
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the dispersive band(s) below the flat band(s) is fuUy oc- 
cupied. In the non-interacting half-fiUing case, the sys- 
tem is in a semi-metal state, since the Fermi velocity is 
vanishing, though there is no excitation gap. In the fol- 
lowing, we study how this state is affected by electron 
correlation. 

As shown in Ref.27, at the half-filling, the perturba- 
tive calculation in U for the Hamiltonian (1) suffers from 
divergences of the single-particle self-energy, due to the 
presence of the flat band(s). In the 2D case, the pertur- 
bative expansion of the self-energy gives. 



ReS'^^(e) ~ const. + cU^ log{8t/e) 



(14) 



In the 3D case, we have, 

ReE^°(£) ~ const. + C2C/^ + C3U^/VW\ 

+C4C/V|£|^/2 + • • •. (15) 

These singular behaviors imply that some instability may 
be induced by electron correlation. To pursue this pos- 
sibility, we will carry out the resummation of divergent 
terms using the renormalization group method in the fol- 
lowing sections. 

III. RENORMALIZATION GROUP EQUATIONS 

To treat the infrared divergences appeared in pertur- 
bative expansion in a controlled manner, we exploit the 
renormalization group (RG) method. In previous appli- 
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a mo- 



cation of the RG method to electron systems 
mentum cutoff that separates the neighborhood of the 
Fermi surface from the higher momentum part is intro- 
duced. However, in the presence of the flat band(s), this 
procedure is not applicable. To circumvent this problem, 
we introduce the infrared energy cutoff A in the following 
manner: 



i}ixa{k,en) = %„ik,en)&i\en\ - A) 

+V;<,(fc,£„)e(A-|£„|). 



(16) 



Here, tjjij,a{k,s) is the Grassmann field corresponding to 

Using a standard method,^^"^^ we obtain the RG equa- 
tions of the single-particle self-energy for electrons in 
the n and u bands, E^iy(fc), and the 4-point vertex 
functions for electrons in the a, /3, 7, and 5 bands. 



dA 



J2S{\e'J-A)Gt^{k') 



(17) 



+e{\e'J-A)6{\en\-A)]G^,,{k)Gt{k') 
X [^rX.(fci. ^2; k, fc')ri'i^(fc, k'; ks, ki)5k,+kM' 
-rW^,(fci, fc; fc3, fc')rX(fc'> k2;k, ki)SkMs+k' 
+^altiki,k; ki, k')Tf^p'^^{k' , ^2; k, k3)5k^+kM+k'] 

+ ^5{\en\-A)G^,ik)r^^ll^^,{kuk2,k,k,ks,ki). (18) 
fe 

Here G^,{k) = [(ie„ - Ek^)S^^ - S;},(fc)]-i and k = 
(ie„,fc) and so forth. r(^)^ is the 6-point vertex. The 
first, second, and third terms of the right-hand side of 
(18) correspond to BCS, ZS, and ZS' processes, respec- 
tively, of which the diagrammatic expressions are shown 
in FIG.2(a). 
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FIG. 2(a) BCS, ZS, and ZS' processes, (b) The six 
species of 4-point vertices. Here "a" and "6" indicate the 
dispersive band and the flat band, respectively, (c) The 
leading singular bubble diagrams. 

In the following, we investigate the RG flow of the 4- 

point vertex functions up to one-loop order, and drop 
the 6-point vertex F^^'^ and the self-energy T,^{k) in the 
right-hand side of (18). In our systems, there are six 
species of 4-point vertices, as shown in FIG. 2(b), apart 
from the spin degrees of freedom and the two-fold de- 
generacy of the flat bands in the 3D case. We assume 
that the momentum dependences of the 4-point vertex 
functions are given mainly by r°(fci, ^2; ^3, ^4) in the 
renormalization processes. This is made explicitly by 
replacing Tabab{ki,k2;k3, ki) with gir°j^j,(A:i, A;2; fca, ki), 
Tbbba{ki,k2;k3,ki) with gir'l^f^^{ki,k2;k3,ki), etc. This 
approximation is fairly good, because in the vicinity 
of the r point, where the most important scattering 
processes occur, the band structure is almost isotropic. 
The spin degrees of freedom of the running couplings gi 
(z = 1 ~ 6) is incorporated by decomposing gi into the 
spin singlet part and the spin triplet part. 
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+ -^(5<7i(73^0-2f4 "I" '^('■lCT4^<72Cr3)- (19) 

It is also convenient in the following to decompose gi into 
the charge part and the spin part, 



/ \ '^gU 9is r 

gj(cTi,<j2;c73,o-4j = (>. 



a 1(74 ^CT2 (73 



+- 



gu 



Because, at the half-filling, the flat bands are empty 
and the dispersive band is fully occupied, the particle- 
particle processes between the flat bands and the particle- 
hole processes between the flat bands and the disper- 
sive band give the leading singular contributions (see 
FIG. 2(c)). We take into account these contributions in 
the derivation of the RG equations. It is straightforward 
to show that in the vicinity of the F point the following 
relations hold: 



BCS 



pO 
aabb bbab 



aabb baaa 



ZS' 



EpO pO 
abab aaab 



ZS' 



Er: 







aabb bbba 



0, 
0, 
0. 
0, 



/ > a 
ZS 

Er° 



pO 
aabb baaa 



bab aaab ' 



ZS 



EpO pO , 
aaab bbab ' 



ZS 



EpO pO 



■ aabb bbba 



'0, 
0, 



ZS 



ZS' 



^ abbb^ bbab ~ ^' 2^ ^ abbb^ bbab ~ ^- 



(21) 



ZS 



ZS' 



Here X^bcs' X^zS' ^^'^ X^zs' ™6an the momentum sum- 
mation in the intermediate state carried out over BCS, 
ZS, and ZS' processes, respectively. Using these relations, 
we flnd that the beta function of 53 is approximately van- 
ishing. 



dg. 



'3s 



dl 



dgst 
dl 



0. 



(22) 



and the RG equations for the other running couplings are 
written, 



dgi 



agl,e^ 



dl Ao 

dgu ^ KApe"')" 
dl 4 
dg2s 



+ ^-^^^^{9l + 69ugu-Sglt), (23) 



{9u-^9isgu + 5gu), 
-|-6(Aoe T[gisg2s 



(24) 



dl Ao 

+3(5is5f2t + gug2s - gug2t)], 

dgn ^ _ag2tg&t^ 
dl ~ Ao ' 
dg4s _ agAsges i . 6(Aoe"')'' 



dl 



Ac 



(25) 

(26) 

{gugis + ^gisgit), (27) 



dg4t 


agagm 


dl 


Ao 


dgss 


} 

agL^ 


dl 


Ao 


dg5t 


1 


dl 


Ac 


dges 




dl 


~ Ao 


dget 


agltj 


dl 


~ Ao 



(20) ^ ^ gget 



(28) 
(29) 
(30) 
(31) 
(32) 



where rj = {d - 2)/2, I = ln(Ao/A), with Ao the band 
width, and d is the spatial dimension. In the 2D case, 

a = Y,i4iik)~sl,{k)sUk))/2, (33) 

k 

b = ^ Im[iA - Ek2]~^/2 w 0.0622/i, (34) 

k 

and in the 3D case. 



« = E[(«nW + ^?2(fc))' 

k 

-{sn(k)s2i{k) + 3,2{k)s22{k))^]/2, 
6 = ^ Im[iA - i;fc3] - V (4 VA) « 0.0775 /i^/^. 



(35) 
(36) 



In the derivation of these equations for the 3D case, we 
have used the fact that in the vicinity of the F point, the 
two degenerate flat bands do not mix with each other 
in scattering processes. Thus in this case the two-fold 
degeneracy just gives an overall factor of 2. 

Since the initial values of the running couplings in the 
triplet channel arc zero for our models (1), the RG equa- 
tions, (26), (28), (30), and (32), give g2t = git = g5t = 
get = 0. In the following sections, we study how the 
RG flows of the other running couplings give rise to non- 
trivial effects. 



IV. 2D PYROCHLORE HUBBARD MODEL 

A. RG analysis 

We first consider the 2D case, whose theoretical treat- 
ment is simpler. We solved the RG equations (23)- (32) 
numerically for a particular set of parameter values, and 
obtained the RG flow shown in FIG. 3. The running cou- 
plings g5s and g^s, of which the RG flows are not shown 
in FIG. 3, are irrelevant in the low-energy limit. We 
found that for any small value of U /t, gu flows into the 
strong-coupling regime. This indicates some instability 
in this channel. Although gig also scales into the strong- 
coupling regime, it is sub-dominant compared to g^. We 
also show in FIG. 3 the RG flows of the couplings 3git—gis 
and gis + git, which are related to the charge and spin 
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susceptibilities, respectively. We see that some instability 
appears in the charge degrees of freedom. To elucidate 
the nature of this instability more precisely, we explore 
how this singularity affects the single-particle self-energy. 
Although the diagonal parts of the self-energy En, S22 
give just a chemical potential shift up to the one loop 
level, the off-diagonal self-energy E12 changes the elec- 
tronic state drastically, as will be shown below. Neglect- 
ing the diagonal self-energy, which are not important in 
the following argument, we expand the RG equation for 
the off-diagonal self-energy (17) up to the first order in 



^12- 



dl 

^1 



26(35it - 5i.)(S^2TT + Si2ii) (37) 



rf(S^2tT ^12ii) _ I „ \/'vA ipA 



dl 



= 2%i,+5„)(Sf2tT-Sf2u) (38) 



"^12Ti 

dl 



26(5is +5it)Sf2Ti- 



(39) 



Because the strongest divergence of the 4-point vertex ap- 
pears in 2>gxt—g\s (see FIG. 3), the off-diagonal self-energy 
Y^cr ^i2o-o- becomes non-zero at some critical A = Ac- 
This is easily seen by solving (37), which gives 



'12aa 



12<7<7'= 



exp[26 / dl'{2,gu-gis)]- (40) 



Although Ej2(T(T is vanishing in the vicinity of the T 
point, because of the momentum dependence of s^y(fc), 
So- ^i2crcr becomes non-zero for A = Ac at which value 
3g\t — gis is divergent. The non-zero off-diagonal self- 
energy hybridizes the band 1 and the band 2 at the T 
point, and drives the system into the insulating state with 
both spin and charge gaps. Thus the singularity of the 
RG flow signifles the (semi-)metal-to-insulator transition. 



right-hand side of the gap equation gives less singular 
contributions than the second term. Thus, the linearized 
gap equation, which determines the transition tempera- 
ture, is, 

Afe = ^ n(fc, q - k)Gn{q - k)G22{q - k) 

q,k' 

X Il{k',q-k)Gii{k')G22{k')Ak', (42) 



where G^^{k) = l/(£„ - Ek^i), k = {is,k), and. 



ll(fc,/cj- 2^ l-c.i?(fc + fc')' 



(43) 



t^{k,k') = (sii(fe).si2(fe')±.si2(fe).sii(fe'))V2, (44) 
D{q) = -TU J2 Gil {k)Gn {q~k), (45) 



n,k 



with c_|_ = 2a, and c_ = X^fe-^ii- Here we have ignored 
the diagonal self-energy. Equation (42) implies that the 
gap function can be written 



/,N /,^A Ao(cOS fca; — cos fc„) 

A. = an(fc).r2(fc)Ao=^il^-^^^^^, (46) 



where Ag is a constant. From (42), we have the equation 
that determines the transition temperature. 



l = ^[lnf^VMlnf^ 



(47) 



B. Mean Field Analysis 

The above RG analysis implies the existence of a mean 
field solution for which the order parameter is given by, 

Afe = ^Ei2aa(fc) ~ (4la«fe2a). (41) 

This state is characterized by electron-hole pairing with 
parallel spins, which leads to the formation of both spin 
and charge gaps preserving the spin rotational symme- 
try. A^; is determined by the self-consistent mean field 
equation, which is obtained as follows. According to the 
numerical analysis of the RG equations (23)-(31), .94,5 is 
mainly renormalized by the first term of the right-hand 
side of (27). Then, the renormalized coupling is ap- 
proximately given by RPA-like expressions. As a result, 
the self-consistent gap equation for is expressed dia- 
grammatically as shown in FIG. 4. The fist term of the 



where bo = 0.322. (47) implies that for U < Uc 
0.725 X 8t, a state with non-zero Aq is realized. Note 
that the gap function (46) has a line node structure simi- 
lar to dx2-y2 symmetry. However, this line node vanishes, 
when we take into account the coupling with lattice, as 
will be discussed in Sec. IV. D. 

Generally, in 2D systems, thermal fluctuations may 
suppress the transition temperature down to zero. The 
above mean field solution is also affected seriously by 
thermal fluctuations, because U(l) Goldstone mode re- 
lated with the phase of (a|j^^afc2cr) does not survive at 
finite temperatures. To see this, we have applied the 
Ginzburg-Landau analysis to this mean field solution 
and found that, in the 2D case, the transition temper- 
ature vanishes in accordance with the Mermin-Wagner- 
Coleman theorem. Nevertheless, the above analysis 
demonstrates that in the groimd state at zero temper- 
ature, the gap A/5 is non-zero, and the system is in an 
insulating state. 
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FIG. 3 The RG flow of the running couplings in the 2D 
case with U/U = 0.25. 

C. Properties of the Insulating state 

1. Spin Gap State with Spin Rotational Symmetry 

We now further investigate the properties of the insu- 
lating phase using the mean field solution. The single- 
particle Green's functions in this state are given by, 



^11 (^5 ^n) — 



7.(+) 



+ 



a 



(-) 



7(-) 



i£ + M - 



(-)' 



is + fi- ie + M - -Efc 



where 



= {Eki + Ek2 ± ^(^fci-i;fc2)2+4A2)/2, 
S(±) - Eki 



(+) 



e: 



(-)■ 



(48) 
(49) 

(50) 
(51) 



In the insulating phase, because the order parameter does 
not break the spin rotational symmetry, there is no long- 
range magnetic order. However, a spin gap exists. The 
spin gap behavior is observed in the temperature depen- 
dence of the spin- lattice relaxation rate 1/Ti probed by 
NMR measurements. It is obtained from the above mean 
field solution. 



1 

7\r 



dE 



2rcosh^ ^' 



N^iE) = /^ 



\ E^ + Al /fe^o 



Ei. 



(52) 
(53) 



Here, (• • •)fc^o is the angular average near k = 0. Because 
of the nodes of A^, wo have, l/(TiT) ^ T"^. However, as 
will be discussed in the next section, the coupling with 
lattice degrees of freedom changes this power law behav- 
ior to an exponential decay, l/(TiT) exp(— A/T). 



2. Charge Ordering 

Another important property of the insulating phase 
manifests in the charge degrees of freedom. The forma- 
tion of the gap Afe brings about a difference between the 
charge densities at the sites 1 and 2 in a unit cell given 
by 



Pi - P2 



sii{k)si2{k)Ak 



e(M-4"^) 



AoA- 



"^W + 4Af 



(54) 



Thus charge ordering (CO) with a charge density dis- 
placement proportional to the gap characterizes this in- 
sulating state. The CO pattern is shown in FIG. 5. This 
noteworthy result can be understood as follows. In our 
system, three electrons occupying nearest neighbor sites 
cost energy loss caused by magnetic frustration. Con- 
versely, magnetic frustration induces an effective finite- 
range repulsion between electrons at nearest neighbor 
sites. If this finite-range repulsion is sufficiently strong 
to overcomes the on-site Coulomb interaction U, the CO 
state will be stabilized. This is possible if U is not so 
large. As U increases, a transition to a conventional Mott 
insulator with no charge ordering should occur. This 
transition cannot be described within our weak-coupling 
analysis. 

The CO pattern shown in FIG. 5 is regarded as an as- 
sembly of onc-dimensional chains in the [1, 1] and [1,-1] 
directions. This observation implies that CO reduces the 
spatial dimension effectively to relax geometrical frustra- 
tion. 



© 
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FIG. 4 Diagrams for the linearized gap equations. 
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FIG.5 The CO pattern in the 2D case. 

D. Coupling with Lattice Distortion 

The presence of CO found in the previous section im- 
phes that the couphng between the charge fluctuation 
and lattice degrees of freedom may give rise to the dis- 
tortion of the lattice structure. Since the band structure 
possesses the double degeneracy at the T point even for 
U = in the half-filling case, the Jahn-Tellar distortion 
may occur to lift the degeneracy. However, in our sys- 
tem the lift of the double degeneracy corresponds to the 
situation that the charge density on the site 1 is different 
from that on the site 2. It is highly non- trivial whether 
the inhomogeneous charge distribution is realized even in 
the presence of the on-site repulsion U, which, in general, 
should suppress the charge fluctuation. The results ob- 
tained in the previous sections remarkably show that the 
interplay between the one-site repulsion and geometrical 
frustration stabilizes the charge ordering in the ground 
state, to which the Jahn-Tellar lattice distortion may ad- 
just. In this section, we discuss the distortion of the 
lattice structure compatible with the CO state. 

Since the band degeneracy appears only at the F point, 
it is suSicient to consider the point group of the tetrago- 
nal crystal system D4h. The doubly degenerated levels at 
the r point belong to Eu representation. There are three 
normal modes which arc relevant to the Jahn-Tellar dis- 
tortion: [Ey] = Ai -|- Big + B2g. The normal coordinates 
of these modes are, respectively, given by, 

Q{Aig) = —Ulx — Uly + U2x — U2y 

+ U3x + my - U4,X + Uiy, (55) 

Q(Big) = Ulx + Uly + U2x — U2y 

-U3x - Usy - U4,x + U4y, (56) 
<3(B2g) = -Ulx + Uly + U2x + U2y 

+U3x - Usy - U4x - U4y, (57) 

where Wj^ {i = 1)2,3,4 and a = x,y,z) is the displace- 
ment of the i-sitc in the a-direction. The lattice dis- 
tortions corresponding to these modes are schematically 
shown in FIG. 6. The lattice distortions change the ki- 
netic term of the Hamiltonian ilkin — > ^fkin+AiJkin with, 

AiJkin = -OlAig ^{cliClj + cliC2j 

+ c\,-C2, + 4iCij)Q(Aig) 

-«Big ^{AiCij - cJiCj)Q(Big) 



-«B2g ^{c[iC2i+a^ - c\iC2i+ay 

i 

+cliCli+a^ - cluCu+ay + /l.C.)Q(B2g) . (58) 

Here we omit the spin index. The Aig and B2g modes 
do not lift the degeneracy at the F point. Obviously, the 
Big mode is the only lattice distortion that is consistent 
with the CO pattern shown in FIG.5. After this lattice 
distortion occurs, the single-particle excitation gap com- 
pletely opens at the F point without line nodes, leading 
the exponential decay of the spin lattice relaxation rate, 
as announced in the previous section. 




Aig Big B2g 



FIG. 6. Three normal modes of the lattice distortion. 



V. 3D PYROCHLORE HUBBARD MODEL 

A. RG Analysis 

The above analysis can be straightforwardly general- 
ized to the case of a 3D pyrochlorc lattice. We obtain 
the RG flow numerically from (23)-(32) for d = 3. Here, 
in contrast to the 2D case, for sufliciently small U all 
couplings are irrelevant, and thus the semi- metal state 
is stable. However, for values of U larger than a cer- 
tain critical value but still smaller than the band width, 
RG flow similar to that in the 2D case is obtained, as 
shown in FIG. 7. The coupling 2>git — gu, which is re- 
lated to the charge degrees of freedom, scales into the 
strong-coupling regime. This RG flow implies that, as 
in the 2D case, a particle-hole pairing between the flat 
bands and the dispersive band is realized below a critical 
temperature, leading spontaneous gap formation both in 
the charge and spin degrees of freedom. Note that the 
spin gap formation does not signify the breaking of the 
spin rotational symmetry, since the vertex in the spin 
degrees of freedom gig + gu is still finite at the critical 
value of ln(Ao/A). 

B. Mean Field Analysis 

Although the value of U used above is relatively large, 
we expect that the one-loop RG calculation still gives 
qualitatively correct results, as long as U is smaller than 
the band width. To examine the validity of the one-loop 
calculation, we explore the self-consistent mean field so- 
lution. The order parameters for the particle-hole pairing 
state suggested from the above RG flows is, 
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a 



(59) 

(60) 



The self-consistent gap equations for the 3D case are also 
given by the diagram shown in FIG. 4, from which we find 
that the gap functions are given by, 



.(23) 



X]s.i(fc)s.3(fc)A(i3) 

v=l 
2 

$^a.i(fc)s.3(fc)(A(i3)-Af)), 

4 

E«-2(fc)s.3(fc)A(23) 

E«^2(fc)s.3(fc)(A(23)-Af)). 



(61) 



(62) 



Here we used the orthogonal relations. Ylt=i •^i'i*V3 = 
'l2t=i '5i^2Si/3 = 0, and S41 = 0. Using the symmetry 
properties of s^i/(fc) in momentum space, we can impose 
some restrictions on the structure of the gap functions 
without solving the gap equations. Under the transfor- 
mation, X ^ y, y ^ X, z 
are transformed as. 



-z, the coefficients of A^.^^^ 



S11S13 

S21S23 
S31S33 



-S21S23, 

-S11S13, 

-S31S33- 



(63) 
(64) 
(65) 



Because of the symmetry of a tetrahedron Tj, the gap 
function should be unchanged up to the sign by this 
transformation. Then, we have, 



Aj'^^=Ar', or 
A(^^)+A(^^)=2Af\ 

In a similar manner, using the transformation, x 
y ^ z, z ^ y, we obtain. 



.(13) 



. (13) _ . (13) 
^1 — ^3 ' 



or 



A(13) + a(^3)^2A(^3)^ 



(66) 
(67) 



(68) 
(69) 



Combining (67) and (69), we end up with A\ = 



A^^^^ = A^^^\ and thus, 



,(13) 



0. 



(70) 



Applying a similar argument to A^^^\ we find A^^^^ = 
Af)=Af),and, 



S42(fc)S43(/e)(Af - A(' 



(23) ^ 



(71) 



The quantity A^^^-* — A^^'^'' is determined from the gap 
equation. According to the RG analysis, the transition 
occurs only for sufficiently large U. Therefore, to de- 
termine the transition temperature and the gap function 
correctly, wo need to take into account the self-energy 
corrections i.e., pair breaking effect. This calculation 
is rather involved, and we have not yet carried it out. 
However, we see from the RG flow that at the critical 
temperature Tc ~ Aoe~'= = 8t x 0.0042, a transition 
from a semi-metal to an insulator occurs. In the result- 
ing insulating state, the three-fold degeneracy at the F 
point in the semi-metal state is lifted completely, and a 
spin gap as well as a charge gap exists. The gap func- 
tion A^ ' has both line and point nodes determined by 
542(^)543 (fc) = 0. However, these nodes are eliminated 
by the coupling with lattice degrees of freedom, as will 
be shown in Sec.V.D. 

The particle-hole pairing state characterized by the or- 
der parameters (59) and (60) is analogous to the excitonic 
insulator. However, this analogy is not complete. In 
contrast to the excitonic insulator which is realized in 
particle-hole symmetric bands, the pairing state found 
above is stabilized by strong interaction between fiat 
bands and dispersive bands in the absence of particle- hole 
symmetry. Thus, we believe that this is a novel mech- 
anism for the particle-hole pairing specific to pyrochlore 
systems. 
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FIG. 7 The RG fiow of the running couplings in the 3D 
case with U/8t = 0.625. 
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C. Properties of the Insulating State 

1. Spin Gap State with Spin Rotational Symmetry 

It is straightforward to compute magnetic properties 
of the gapped state using the mean field solution ob- 
tained in the previous section. In the insulating phase 
with the single-particle excitation gap A^^^\ the spin- 
lattice relaxation rate 1/Ti is also given by (53). Since 
the gap fimction has nodes, l/{TiT) decreases in a power 
law as temperature is lowered: l/(TiT) ~ T^. How- 
ever, as will be discussed in Sec. V.D, in the pres- 
ence of the coupling with lattice degrees of freedom, the 
nodes of the gap function disappear. In this case, the 
spin-lattice relaxation rate shows a exponential behav- 
ior, l/{TiT) ^ exp(-A/r). 

The spin gap behavior appears in the spin-spin cor- 
relation function ImXsiq,^^) for all q. The momentum 
dependence of ImXs(g, w) is quite small, indicating that 
geometrical frustration suppresses any tendency toward a 
conventional magnetic order. Such small q-dcpcndcncc of 
Imxs(g,w) was also found in the semi- metal state above 

m 27 
c- 

2. Charge Ordering 

Here, we examine the possibility of a CO state in the 
3D system. There are four sites in a unit cell. The ap- 
pearance of a gap causes a charge density displacement 
on each site given by, 

5p, = 2^5,2 (fc)s.3(fc)A^''\ (72) 
fe 

for u = 1,2, 3, and, 

3 

<5p4 = - ^ 5p.. (73) 

Using the symmetry properties of s^i,{k), we obtain, 

5pi = Sp2 = 6p3 ^ 0, (74) 
6p4 = -35pi. (75) 

It is thus found that CO with the pattern displayed 
in FIG. 8 occurs in the insulating phase. Interestingly, 
a similar CO pattern is observed in the spinel system 
AIV2O4 which possesses a V-site corner-sharing tetrahe- 
dron network.'''''' Within the above analysis, the sign of 
(5/94, which depends on the phase of the order parame- 
ter A4^^' — A^^^\ is not determined. Thus, the states of 
Sp4 > and 6p4 < arc degenerated. As will be dis- 
cussed in the next section, this degeneracy is lifted by 
the coupling with lattice degrees of freedom. 

Note that the CO pattern shown in FIG. 8 is regarded 
as an alternate stack of 2D kagome lattices and trian- 
gular lattices in the [—1,1,-1] direction. As in the 2D 



case, CO brings about the effective reduction of spatial 
dimension to relax geometrical frustration. 




FIG.8. The CO pattern in the 3D case. 

D. Coupling with Lattice Distortion 

As in the 2D case, CO found in the previous section 
may bring about lattice distortion. Here, we discuss this 
possibility. Since, at the half-filling, all important pro- 
cesses occur in the vicinity of the F point, it is sufficient 
to consider the point group of the tetrahedron T^. The 
representation of T^ is reduced to Ai -I-T2. The triply de- 
generated levels at the F point Eki = Ek2 = Ekz {k = 0) 
belong to T2. Thus, the normal modes that may lift 
the degeneracy are obtained from the symmetric prod- 
uct representation, [T2^] = Ai -|- E -|- T2. The normal 
coordinates corresponding to these three modes are, 

<3(Al) = {Uix - U2x + U3x - U4x 
+Uiy - U2y - Usy + U4y 

+Uiz + U2z — Usz — Uiz)/ \/3, (76) 
Q(1)(E) = {Uix - U2x + U3x - Uix 
+Uly — U2y — U3y + UAy 

-2uiz - 2u2z + 2w3^ + 2w4z)/V6, (77) 



g(2) (E) = (uix - U2x + U3x - Uix 

-Uiy + U2x + U3 Uix)/V2, (78) 

g(l)(T2) = Ulx + U2x - U3x - U4x, (79) 

Q(2)(T2) = Uly - U2y + U3y - Uiy, (80) 

Q^^\T2) = Uiz-U2z-U3z+Uiz. (81) 



They are schematically shown in FIG. 9(a), (b), and (c). 
The breezing mode Ai does not lift the degeneracy at 
the F point. The E and T2 modes split the triply degen- 
erated levels into three different levels or one separated 
level and doubly degenerated levels. The modification of 
the kinetic energy due to these modes are, 

- 4cj3 - c|2Cj4 - 4cj4 + h.C.) 

Q^'HE),t t t t . 

+ 2 ^'^^l^^'* ^ ^^2Cj3 - cjiCjS - c\2Cji + h.C.) 
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+ 



+ 



Q(^. t 



V2 



72 

(4cj2 - C%Cj4 + h.c.) 



x/2 



(4lCj3 - 4^0,4, + h.c.) 



(82) 



Since the stretch of bonds may reduce the hopping in- 
tegral, it is plausible to assume 6e > and > 0. 
The lattice distortion that is consistent with the CO pat- 
tern shown in FIG. 8 is obtained by putting Q''^\T2) = 
-Q(2)(T2) = -g(3)(T2) ^ 0, and Q(i)(E) - g(2)(E) ^ 
0. This mode is shown in FIG. 10. Here we have dropped 
the rotational degrees of freedom around (—1,1, — l)-axis. 
For Q^^''{T2) > 0, the triply degenerated levels at the T 
point split into one lower level and upper doubly degener- 
ated levels. Thus, at the half-filling, this lattice distortion 
generates a full gap without a node in the single-particle 
excitation. Note that the full gap opens not only at the 
F point but also over the entire Brillouin zone, as easily 
verified by diagonalizing the kinetic term with this lat- 
tice distortion. On the other hand, for Q^^'^{T2) < 0, the 
lower levels are doubly degenerated, and the system is 
still in the semi-metallic state unless we do not take into 
account the correlation-driven CO transition obtained in 
the previous sections. Thus it is expected that the case 
of Q^^'(T2) > 0, in which both the lattice distortion and 
electron correlation stabilize the gapped state, is ener- 
getically favorable. Under the trigonal distortion with 
q(i)(X2) > shown in FIG. 10, the charge density on the 
site 4 in the tetrahedron is larger than those on the other 
three sites. This is easily seen by calculating straightfor- 
wardly the charge density on each site in a single tetrahe- 
dron with the trigonal distortion. Then, the sigh of Sp4, 
which is not determined in the absence of the lattice- 
coupling as mentioned in the previous sections, is chosen 
as dp4 > by the lattice distortion. 

The lattice distortion discussed here and the CO state 
shown in FIG. 8 are similar to the experimental obser- 
vation for AIV2O4, apart from the doubling of the unit 
cell in the [1, 1, 1] direction found in A1V204.^''' Since, in 
AIV2O4, the t2g orbital of V sites plays a central role, 
our simple model is not directly applicable to this sys- 
tem. However, according to the recent LDA calculation, 
the band structure near the Fermi surface possesses s-like 
character because the s orbital of Al site partially hy- 
bridizes with the aig orbital split from the t2g orbital by 
a trigonal crystal field. Thus, CO observed in AIV2O4 
may be microscopically explained by the mechanism de- 
scribed here. It should be emphasized that in our sce- 
nario, the interplay between electron correlation and ge- 
ometrical frustration is the most important ingredient for 
the realization of the CO state and the lattice distortion 
is merely a secondary effect. 




X y 



T2 



FIG.9. The normal modes of Td. (a) Ai (b) E (c) T2. 




FIG. 10. The lattice distortion consistent with the CO 
pattern shown in FIG. 8. 



E. Application to MIT in TI2RU2O7 

We now apply the results obtained above to the de- 
scription of the MIT observed in TI2RU2O7. As men- 
tioned in the introduction, according to Ishii and Oguchi, 
the electronic structure of this system consists of the s- 
orbital of Tl sites, as well as the t2g-orbitals of Ru sites. ^® 
The band structure formed by the former is well approx- 
imated by our model. The band calculation gives the 
band width of this system 8t ~ 2eV.^^ Experimental data 
on the size of U do not exists. However, typically, the 
value of U for transition metal oxides is ~ 2eV. This gives 
us reason to believe that the analysis presented in this pa- 
per, which suggests that the MIT occurs for large U ~ 8t, 
can be applied to the description of the TI2RU2O7 sys- 
tem. The transition temperature estimated from the RG 
analysis is Tc ^ 98K, which is almost comparable with 
the experimental values 100 120K.^^ A recent NMR 
measurement of Tl nuclei has revealed the presence of a 
spin gap in the insulating state, which is consistent with 
our results.^'' The possible existence of a CO state and 
large enhancement of charge fluctuations above pre- 
dicted in our theory have not yet been investigated exper- 
imentally. The experimental determination of whether a 
CO state exists for TI2RU2O7 is a crucial test of this the- 
ory. When there exists coupling to a lattice, CO should 
accompany lattice distortion. As discussed in Sec.V.C, 
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the CO pattern found in this study suggests that the cu- 
bic lattice symmetry is broken down to trigonal symme- 
try. Actually, it has been found experimentally that, in 
TI2RU2O7, the lattice structure changes discontinuously 
at the MIT point. This observation seems to suggest the 
presence of large charge fluctuations in this system. 



VI. SUMMARY 

We have studied the MIT caused by the interplay be- 
tween geometrical frustration and electron correlation. 
We have found, using the RG method and mean field 
analysis, that, the 2D and 3D pyrochlorc Hubbard mod- 
els at the half-filling show the transition from semi-metal 
to spin-gapped insulator. The transition occurs at a finite 
critical temperature T,, in the 3D case, and at T = in 
the 2D case. In the insulating state, CO occurs concomi- 
tantly so as to relax geometrical frustration. The results 
obtained here are successfully applied to the description 
of the MIT observed in the pyrochlore oxide TI2RU2O7, 
though it is a future issue to examine experimentally the 
presence of the CO state in this system, as predicted from 
our theory. The CO pattern found in this paper is also 
very similar to that observed in AIV2O4. The mechanism 
for CO in this system may be explained by the scenario 
described in this paper, because the electronic structure 
of AIV2O4 possesses partially flat bands, '"'^ which is a cru- 
cial ingredient for CO induced by geometrical frustration. 
It is a future issue to explore this possibility taking into 
account the t2g orbitals of V sites. 

The insulating state found in our systems is character- 
ized by particle-hole pairing. In this sense, it is anal- 
ogous to the excitonic insulator. However, there are 
some important differences between them. In contrast 
to the excitonic insulator, the spin gapped insulator in 
the pyrochlore Hubbard models is stabilized by the pres- 
ence of flat bands originated from geometrical frustra- 
tion. Interestingly, Singh et al. pointed out a possibility 
of the excitonic insulator realized in the pyrochlore ox- 
ides Cd20s207.^^ Since its electronic structure near the 
Fermi energy consists of the t2g manifolds, our model is 
not simply applicable to this system. It is an intriguing 
issue to extend our analysis to more realistic models with 
this electronic structure. 
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